Image processing method, apparatus and system

ABSTRACT

An image processing method comprises receiving, from a camera, a camera captured image comprising a user drawn image. At least part of the user drawn image is within a field of view of the camera. The method comprises applying an image processing operation to the camera captured image so as to generate an image feature within the camera captured image which corresponds to the user drawn image, and thinning the image feature to a line width which is smaller than a line width associated with the image feature so as to generate a modified width image feature. The method further comprises generating vector data from pixels associated with the modified width image feature so that the vector data substantially represents the modified width image feature.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to an image processing method, apparatusand system.

2. Description of the Prior Art

Recently, with the advent of ever more powerful computers and videogames consoles, computer games are starting to incorporate augmentedreality images in which images captured by a camera are combined withcomputer generated images so as to produce a content-rich mediaexperience for a user.

Additionally, with increasingly powerful image processing techniques,added functionality between a user and an entertainment device may byprovided by the use of a camera to capture images of a user. Inparticular, some systems allow a user to draw a user drawn image on asuitable drawing surface so that the camera can capture an image of theuser drawn image. The entertainment device can then carry out imageprocessing on the captured image so that the user drawn image can beincluded in a game. Other image processing operations can then beapplied to the user drawn image so as to provide an enhanced gamingexperience for the user.

However, in order to provide this functionality, the entertainmentdevice should be able to generate a digital representation of the userdrawn image. One way to achieve this would be to generate bitmap datafrom the user drawn image which corresponds to the user drawn image.However, it may be difficult to isolate the user drawn image from thebackground, or from the drawing surface, which may lead to an appearancethat the user drawn image has just been “stuck on” to the computergenerated image or augmented reality image. Furthermore, if other imageoperations such as image scaling is carried out on bitmap data, theimage quality may be degraded, especially if the user drawn image isenlarged.

The present invention seeks to alleviate or mitigate the above problems.

SUMMARY OF THE INVENTION

In a first aspect, there is provided an image processing methodcomprising: receiving, from a camera, a camera captured image comprisinga user drawn image, at least part of the user drawn image being within afield of view of the camera; applying an image processing operation tothe camera captured image so as to generate an image feature within thecamera captured image which corresponds to the user drawn image;thinning the image feature to a line width which is smaller than a linewidth associated with the image feature so as to generate a modifiedwidth image feature; and generating vector data from pixels associatedwith the modified width image feature so that the vector datasubstantially represents the modified width image feature.

In a second aspect, there is provided an image processing apparatuscomprising: receiving means operable to receive, from a camera, a cameracaptured image comprising a user drawn image, at least part of the userdrawn image being within a field of view of the camera; image processingmeans operable to apply an image processing operation to the cameracaptured image so as to generate an image feature within the cameracaptured image which corresponds to the user drawn image; image thinningmeans operable to thin the image feature to a line width which issmaller than a line width associated with the image feature so as togenerate a modified width image feature; and vector data generatingmeans operable to generate vector data from pixels associated with themodified width image feature so that the vector data substantiallyrepresents the modified width image feature.

By thinning the image feature generated from the user drawn image, arepresentation of lines which can be used to reproduce the user drawnimage can be obtained. Furthermore, by generating vector data from themodified width image feature, the vector data can be generated such thatit substantially represents the modified width image feature. The vectordata can then be used to reproduce the main features of the user drawnimage within a game.

For example, in an augmented reality game in which a virtual pet iscombined with camera captured images so as to interact with a user via acamera, the user could draw an image on a suitable drawing surface. Thecamera could capture the image drawn by the user and the entertainmentdevice causes the virtual pet to appear to copy the user drawn image.This advantageously improves a gaming experience for a user.

Furthermore, by generating vector data from a thinned image feature,different image processing operations can be applied to the vector datawithout a degradation in image quality. Additionally, vector datatypically has a smaller file size than bitmap data. Therefore, the useof vector data based on a thinned image feature generated from a cameracaptured image comprising a user drawn image reduces processing andmemory resources needed to implement image processing within a game.

Various other respective aspects and features of the invention aredescribed in the appended claims.

BRIEF DESCRIPTION OF THE DRAWINGS

The above and other objects, features and advantages of the inventionwill be apparent from the following detailed description of illustrativeembodiments which is to be read in connection with the accompanyingdrawings in which:

FIG. 1 is a schematic diagram of an entertainment device;

FIG. 2 is a schematic diagram of a cell processor;

FIG. 3 is a schematic diagram of a video graphics processor;

FIG. 4 is a schematic diagram of an entertainment system arranged tocapture an image comprising a user drawn image using a camera inaccordance with an embodiment of the present invention;

FIG. 5 is a schematic diagram of an example of vector generation from auser drawn image;

FIG. 6 is a schematic diagram of an example of rendering operationsapplied to vector data generated from a user drawn image;

FIG. 7 is a schematic diagram of a camera captured image comprising userdrawn images in accordance with embodiments of the present invention;and

FIG. 8 is a schematic diagram of a camera captured image to which imageprocessing and thinning has been applied in accordance with embodimentsof the present invention.

FIG. 9 is a schematic diagram of a modified width image feature fromwhich vector data is to be generated in accordance with embodiments ofthe present invention;

FIG. 10 is a flowchart of a method of generating vector data inaccordance with embodiments of the present invention;

FIG. 11 is a schematic diagram of a camera captured image comprising auser drawn image in accordance with embodiments of the presentinvention; and

FIG. 12 is a schematic diagram of a boundary between a flood filledimage region and a user drawn image; and

FIG. 13 is a schematic diagram of the association of pixels withdetected boundary pixels.

DESCRIPTION OF THE PREFERRED EMBODIMENTS

An image processing method, apparatus and system are disclosed. In thefollowing description, a number of specific details are presented inorder to provide a thorough understanding of embodiments of the presentinvention. However, it will be apparent to a person skilled in the artthat these specific details need not be employed to practise the presentinvention. Conversely, specific details known to the person skilled inthe art are omitted for the purposes of clarity in presenting theembodiments.

FIG. 1 schematically illustrates the overall system architecture of theSony® Playstation 3® entertainment device. A system unit 10 is provided,with various peripheral devices connectable to the system unit.

The system unit 10 comprises: a Cell processor 100; a Rambus® dynamicrandom access memory (XDRAM) unit 500; a Reality Synthesiser graphicsunit 200 with a dedicated video random access memory (VRAM) unit 250;and an I/O bridge 700.

The system unit 10 also comprises a Blu Ray® Disk BD-ROM® optical diskreader 430 for reading from a disk 440 and a removable slot-in hard diskdrive (HDD) 400, accessible through the I/O bridge 700. Optionally thesystem unit also comprises a memory card reader 450 for reading compactflash memory cards, Memory Stick® memory cards and the like, which issimilarly accessible through the I/O bridge 700.

The I/O bridge 700 also connects to four Universal Serial Bus (USB) 2.0ports 710; a gigabit Ethernet port 720; an IEEE 802.11b/g wirelessnetwork (Wi-Fi) port 730; and a Bluetooth® wireless link port 740capable of supporting up to seven Bluetooth connections.

In operation the I/O bridge 700 handles all wireless, USB and Ethernetdata, including data from one or more game controllers 751. For examplewhen a user is playing a game, the I/O bridge 700 receives data from thegame controller 751 via a Bluetooth link and directs it to the Cellprocessor 100, which updates the current state of the game accordingly.

The wireless, USB and Ethernet ports also provide connectivity for otherperipheral devices in addition to game controllers 751, such as: aremote control 752; a keyboard 753; a mouse 754; a portableentertainment device 755 such as a Sony Playstation Portable®entertainment device; a video camera such as an EyeToy® video camera756; and a microphone headset 757. Such peripheral devices may thereforein principle be connected to the system unit 10 wirelessly; for examplethe portable entertainment device 755 may communicate via a Wi-Fi ad-hocconnection, whilst the microphone headset 757 may communicate via aBluetooth link.

The provision of these interfaces means that the Playstation 3 device isalso potentially compatible with other peripheral devices such asdigital video recorders (DVRs), set-top boxes, digital cameras, portablemedia players, Voice over IP telephones, mobile telephones, printers andscanners.

In addition, a legacy memory card reader 410 may be connected to thesystem unit via a USB port 710, enabling the reading of memory cards 420of the kind used by the Playstation® or Playstation 2® devices.

In the present embodiment, the game controller 751 is operable tocommunicate wirelessly with the system unit 10 via the Bluetooth link.However, the game controller 751 can instead be connected to a USB port,thereby also providing power by which to charge the battery of the gamecontroller 751. In addition to one or more analogue joysticks andconventional control buttons, the game controller is sensitive to motionin 6 degrees of freedom, corresponding to translation and rotation ineach axis. Consequently gestures and movements by the user of the gamecontroller may be translated as inputs to a game in addition to orinstead of conventional button or joystick commands. Optionally, otherwirelessly enabled peripheral devices such as the Playstation Portabledevice may be used as a controller. In the case of the PlaystationPortable device, additional game or control information (for example,control instructions or number of lives) may be provided on the screenof the device. Other alternative or supplementary control devices mayalso be used, such as a dance mat (not shown), a light gun (not shown),a steering wheel and pedals (not shown) or bespoke controllers, such asa single or several large buttons for a rapid-response quiz game (alsonot shown).

The remote control 752 is also operable to communicate wirelessly withthe system unit 10 via a Bluetooth link. The remote control 752comprises controls suitable for the operation of the Blu Ray Disk BD-ROMreader 430 and for the navigation of disk content.

The Blu Ray Disk BD-ROM reader 430 is operable to read CD-ROMscompatible with the Playstation and PlayStation 2 devices, in additionto conventional pre-recorded and recordable CDs, and so-called SuperAudio CDs. The reader 430 is also operable to read DVD-ROMs compatiblewith the Playstation 2 and PlayStation 3 devices, in addition toconventional pre-recorded and recordable DVDs. The reader 430 is furtheroperable to read BD-ROMs compatible with the Playstation 3 device, aswell as conventional pre-recorded and recordable Blu-Ray Disks.

The system unit 10 is operable to supply audio and video, eithergenerated or decoded by the Playstation 3 device via the RealitySynthesiser graphics unit 200, through audio and video connectors to adisplay and sound output device 300 such as a monitor or television sethaving a display 305 and one or more loudspeakers 310. The audioconnectors 210 may include conventional analogue and digital outputswhilst the video connectors 220 may variously include component video,S-video, composite video and one or more High Definition MultimediaInterface (HDMI) outputs. Consequently, video output may be in formatssuch as PAL or NTSC, or in 720p, 1080i or 1080p high definition.

Audio processing (generation, decoding and so on) is performed by theCell processor 100. The Playstation 3 device's operating system supportsDolby® 5.1 surround sound, Dolby® Theatre Surround (DTS), and thedecoding of 7.1 surround sound from Blu-Ray® disks.

In the present embodiment, the video camera 756 comprises a singlecharge coupled device (CCD), an LED indicator, and hardware-basedreal-time data compression and encoding apparatus so that compressedvideo data may be transmitted in an appropriate format such as anintra-image based MPEG (motion picture expert group) standard fordecoding by the system unit 10. The camera LED indicator is arranged toilluminate in response to appropriate control data from the system unit10, for example to signify adverse lighting conditions. Embodiments ofthe video camera 756 may variously connect to the system unit 10 via aUSB, Bluetooth or Wi-Fi communication port. Embodiments of the videocamera may include one or more associated microphones and also becapable of transmitting audio data. In embodiments of the video camera,the CCD may have a resolution suitable for high-definition videocapture. In use, images captured by the video camera may for example beincorporated within a game or interpreted as game control inputs.

In general, in order for successful data communication to occur with aperipheral device such as a video camera or remote control via one ofthe communication ports of the system unit 10, an appropriate piece ofsoftware such as a device driver should be provided. Device drivertechnology is well-known and will not be described in detail here,except to say that the skilled man will be aware that a device driver orsimilar software interface may be required in the present embodimentdescribed.

Referring now to FIG. 2, the Cell processor 100 has an architecturecomprising four basic components: external input and output structurescomprising a memory controller 160 and a dual bus interface controller170A,B; a main processor referred to as the Power Processing Element150; eight co-processors referred to as Synergistic Processing Elements(SPEs) 110A-H; and a circular data bus connecting the above componentsreferred to as the Element Interconnect Bus 180. The total floatingpoint performance of the Cell processor is 218 GFLOPS, compared with the6.2 GFLOPs of the Playstation 2 device's Emotion Engine.

The Power Processing Element (PPE) 150 is based upon a two-waysimultaneous multithreading Power 970 compliant PowerPC core (PPU) 155running with an internal clock of 3.2 GHz. It comprises a 512 kB level 2(L2) cache and a 32 kB level 1 (L1) cache. The PPE 150 is capable ofeight single position operations per clock cycle, translating to 25.6GFLOPs at 3.2 GHz. The primary role of the PPE 150 is to act as acontroller for the Synergistic Processing Elements 110A-H, which handlemost of the computational workload. In operation the PPE 150 maintains ajob queue, scheduling jobs for the Synergistic Processing Elements110A-H and monitoring their progress. Consequently each SynergisticProcessing Element 110A-H runs a kernel whose role is to fetch a job,execute it and synchronise with the PPE 150.

Each Synergistic Processing Element (SPE) 110A-H comprises a respectiveSynergistic Processing Unit (SPU) 120A-H, and a respective Memory FlowController (MFC) 140A-H comprising in turn a respective Dynamic MemoryAccess Controller (DMAC) 142A-H, a respective Memory Management Unit(MMU) 144A-H and a bus interface (not shown). Each SPU 120A-H is a RISCprocessor clocked at 3.2 GHz and comprising 256 kB local RAM 130A-H,expandable in principle to 4 GB. Each SPE gives a theoretical 25.6GFLOPS of single precision performance. An SPU can operate on 4 singleprecision floating point members, 4 32-bit numbers, 8 16-bit integers,or 16 8-bit integers in a single clock cycle. In the same clock cycle itcan also perform a memory operation. The SPU 120A-H does not directlyaccess the system memory XDRAM 500; the 64-bit addresses formed by theSPU 120A-H are passed to the MFC 140A-H which instructs its DMAcontroller 142A-H to access memory via the Element Interconnect Bus 180and the memory controller 160.

The Element Interconnect Bus (EIB) 180 is a logically circularcommunication bus internal to the Cell processor 100 which connects theabove processor elements, namely the PPE 150, the memory controller 160,the dual bus interface 170A,B and the 8 SPEs 110A-H, totaling 12participants. Participants can simultaneously read and write to the busat a rate of 8 bytes per clock cycle. As noted previously, each SPE110A-H comprises a DMAC 142A-H for scheduling longer read or writesequences. The EIB comprises four channels, two each in clockwise andanti-clockwise directions. Consequently for twelve participants, thelongest step-wise data-flow between any two participants is six steps inthe appropriate direction. The theoretical peak instantaneous EIBbandwidth for 12 slots is therefore 96B per clock, in the event of fullutilisation through arbitration between participants. This equates to atheoretical peak bandwidth of 307.2 GB/s (gigabytes per second) at aclock rate of 3.2 GHz.

The memory controller 160 comprises an XDRAM interface 162, developed byRambus Incorporated. The memory controller interfaces with the RambusXDRAM 500 with a theoretical peak bandwidth of 25.6 GB/s.

The dual bus interface 170A,B comprises a Rambus FlexIO® systeminterface 172A,B. The interface is organised into 12 channels each being8 bits wide, with five paths being inbound and seven outbound. Thisprovides a theoretical peak bandwidth of 62.4 GB/s (36.4 GB/s outbound,26 GB/s inbound) between the Cell processor and the I/O Bridge 700 viacontroller 170A and the Reality Simulator graphics unit 200 viacontroller 170B.

Data sent by the Cell processor 100 to the Reality Simulator graphicsunit 200 will typically comprise display lists, being a sequence ofcommands to draw vertices, apply textures to polygons, specify lightingconditions, and so on.

Referring now to FIG. 3, the Reality Simulator graphics (RSX) unit 200is a video accelerator based upon the NVidia® G70/71 architecture thatprocesses and renders lists of commands produced by the Cell processor100. The RSX unit 200 comprises a host interface 202 operable tocommunicate with the bus interface controller 170B of the Cell processor100; a vertex pipeline 204 (VP) comprising eight vertex shaders 205; apixel pipeline 206 (PP) comprising 24 pixel shaders 207; a renderpipeline 208 (RP) comprising eight render output units (ROPs) 209; amemory interface 210; and a video converter 212 for generating a videooutput. The RSX 200 is complemented by 256 MB double data rate (DDR)video RAM (VRAM) 250, clocked at 600 MHz and operable to interface withthe RSX 200 at a theoretical peak bandwidth of 25.6 GB/s. In operation,the VRAM 250 maintains a frame buffer 214 and a texture buffer 216. Thetexture buffer 216 provides textures to the pixel shaders 207, whilstthe frame buffer 214 stores results of the processing pipelines. The RSXcan also access the main memory 500 via the EIB 180, for example to loadtextures into the VRAM 250.

The vertex pipeline 204 primarily processes deformations andtransformations of vertices defining polygons within the image to berendered.

The pixel pipeline 206 primarily processes the application of colour,textures and lighting to these polygons, including any pixeltransparency, generating red, green, blue and alpha (transparency)values for each processed pixel. Texture mapping may simply apply agraphic image to a surface, or may include bump-mapping (in which thenotional direction of a surface is perturbed in accordance with texturevalues to create highlights and shade in the lighting model) ordisplacement mapping (in which the applied texture additionally perturbsvertex positions to generate a deformed surface consistent with thetexture).

The render pipeline 208 performs depth comparisons between pixels todetermine which should be rendered in the final image. Optionally, ifthe intervening pixel process will not affect depth values (for examplein the absence of transparency or displacement mapping) then the renderpipeline and vertex pipeline 204 can communicate depth informationbetween them, thereby enabling the removal of occluded elements prior topixel processing, and so improving overall rendering efficiency. Inaddition, the render pipeline 208 also applies subsequent effects suchas full-screen anti-aliasing over the resulting image.

Both the vertex shaders 205 and pixel shaders 207 are based on theshader model 3.0 standard. Up to 136 shader operations can be performedper clock cycle, with the combined pipeline therefore capable of 74.8billion shader operations per second, outputting up to 840 millionvertices and 10 billion pixels per second. The total floating pointperformance of the RSX 200 is 1.8 TFLOPS.

Typically, the RSX 200 operates in close collaboration with the Cellprocessor 100; for example, when displaying an explosion, or weathereffects such as rain or snow, a large number of particles must betracked, updated and rendered within the scene. In this case, the PPU155 of the Cell processor may schedule one or more SPEs 110A-H tocompute the trajectories of respective batches of particles. Meanwhile,the RSX 200 accesses any texture data (e.g. snowflakes) not currentlyheld in the video RAM 250 from the main system memory 500 via theelement interconnect bus 180, the memory controller 160 and a businterface controller 170B. The or each SPE 110A-H outputs its computedparticle properties (typically coordinates and normals, indicatingposition and attitude) directly to the video RAM 250; the DMA controller142A-H of the or each SPE 110A-H addresses the video RAM 250 via the businterface controller 170B. Thus in effect the assigned SPEs become partof the video processing pipeline for the duration of the task.

In general, the PPU 155 can assign tasks in this fashion to six of theeight SPEs available; one SPE is reserved for the operating system,whilst one SPE is effectively disabled. The disabling of one SPEprovides a greater level of tolerance during fabrication of the Cellprocessor, as it allows for one SPE to fail the fabrication process.Alternatively if all eight SPEs are functional, then the eighth SPEprovides scope for redundancy in the event of subsequent failure by oneof the other SPEs during the life of the Cell processor.

The PPU 155 can assign tasks to SPEs in several ways. For example, SPEsmay be chained together to handle each step in a complex operation, suchas accessing a DVD, video and audio decoding, and error masking, witheach step being assigned to a separate SPE. Alternatively or inaddition, two or more SPEs may be assigned to operate on input data inparallel, as in the particle animation example above.

Software instructions implemented by the Cell processor 100 and/or theRSX 200 may be supplied at manufacture and stored on the HDD 400, and/ormay be supplied on a data carrier or storage medium such as an opticaldisk or solid state memory, or via a transmission medium such as a wiredor wireless network or internet connection, or via combinations ofthese.

The software supplied at manufacture comprises system firmware and thePlaystation 3 device's operating system (OS). In operation, the OSprovides a user interface enabling a user to select from a variety offunctions, including playing a game, listening to music, viewingphotographs, or viewing a video. The interface takes the form of aso-called cross media-bar (XMB), with categories of function arrangedhorizontally. The user navigates by moving through the function icons(representing the functions) horizontally using the game controller 751,remote control 752 or other suitable control device so as to highlight adesired function icon, at which point options pertaining to thatfunction appear as a vertically scrollable list of option icons centredon that function icon, which may be navigated in analogous fashion.However, if a game, audio or movie disk 440 is inserted into the BD-ROMoptical disk reader 430, the Playstation 3 device may select appropriateoptions automatically (for example, by commencing the game), or mayprovide relevant options (for example, to select between playing anaudio disk or compressing its content to the HDD 400).

In addition, the OS provides an on-line capability, including a webbrowser, an interface with an on-line store from which additional gamecontent, demonstration games (demos) and other media may be downloaded,and a friends management capability, providing on-line communicationwith other Playstation 3 device users nominated by the user of thecurrent device; for example, by text, audio or video depending on theperipheral devices available. The on-line capability also provides foron-line communication, content download and content purchase during playof a suitably configured game, and for updating the firmware and OS ofthe Playstation 3 device itself. It will be appreciated that the term“on-line” does not imply the physical presence of wires, as the term canalso apply to wireless connections of various types.

Embodiments of the present invention in which vector data is generatedfrom an image drawn by a user will now be described with reference toFIGS. 4 to 13.

FIG. 4 is a schematic drawing of an entertainment system arranged tocapture an image comprising a user drawn image using a camera inaccordance with embodiments of the present invention.

In particular, FIG. 4 shows the video camera 756 arranged to capture animage of a wipeable whiteboard 1000 comprising a drawing surface onwhich a user 1002 may draw a user drawn image. The camera 756 isoperable to transmit a camera captured image comprising the user drawnimage to the system unit 10 so that the system unit 10 can cause thecamera-captured image to be displayed on the display and sound outputdevice 300.

For example, a user is able to input a blueprint for an object that canoccupy the augmented reality environment and can interact with a virtualpet and/or other objects in an augmented reality environment. In thisexample, the user takes the wipeable whiteboard 1000, and draws anobject upon it. However, it will be appreciated that the user may drawon a surface such as paper, card, slate, and the like, although anysuitable drawing surface could be used. The user then notifies theentertainment device 10 that they have such a drawing, for example byselecting a menu item or pressing an assigned key on the controller.

At this point the entertainment device 10 outputs a video image to thedisplay 300 that indicates the desired scale and orientation of thedrawing for presentation to the video camera 756, for example byoverlaying a frame of a certain size and orientation in front of thecaptured video feed from the camera 756.

The user positions the drawing so as to occupy this frame, and a captureof the user drawn image is taken. The captured drawing is analysed asdescribed below so as to generate vector data associated with the userdrawn image. This allows the entertainment device to render an imagewithin the augmented reality environment which substantially correspondsto the user drawn image.

A possible way in which vector data may be generated from the user drawnimage will now be described with reference to FIG. 5.

FIG. 5 is a schematic diagram of an example of vector generation from auser drawn image. In particular, FIG. 5 shows an image feature 1010 afrom which vector data may be generated so that the image feature 1010 acan later be rendered as an image feature 1010 b. In some examples, thecell processor 100 is operable to generate vector data from the imagefeature 1010 a by detecting the edges of the image feature 1010 a usingknown techniques such as Canny edge detection.

The cell processor 100 is then operable to generate vector data usingknown techniques by detecting connected pixels within the image feature1010 a and generating a plurality of vectors so as to fill in theoutline of the image feature 1010 a. An example of generated vectors1020 is shown in the bottom left hand corner of the image feature 1010a, where each line represents a vector. Although, only some vectors areshown, it will be appreciated that the vectors substantially fill theoutline of the image feature 1010 a thus allowing the image feature 1010b to be rendering at a later time using the generated vectors.

However, there are some drawbacks and disadvantages associated with thistechnique.

Firstly, the amount of vector data generated can be large, especially ifthe image feature from which the vectors are generated is complex inappearance (e.g. outline, colour etc.). Additionally, if the originalimage feature was stored as a bitmap, the resultant vector data whichrepresents that bitmap can, in some cases, have a larger file size thanthe original bitmap. Therefore, using this method to generate vectorsfrom a captured image feature can lead to an inefficient use of memory.

Secondly, as the vectors generated from the image feature 1010 asubstantially fill the image feature 1010 a to the edge of the imagefeature 1010 a, it may be difficult to carry out other image processingoperations on the vectors representing the image feature 1010 a so as toalter the appearance from that illustrated as image feature 1010 b inFIG. 5. For example, as shown schematically in FIG. 6, it may desirableto carry out other image processing operations so as to alter theappearance of the image feature 1010 a when reproducing the imagefeature in a game or art package.

To address these problems, embodiments of the present invention thin theimage feature to a line width which is smaller than a line widthassociated with the image feature so as to generate a modified widthimage feature. The cell processor 100 is then operable to generate thevector data from pixels associated with the modified width image featureso that the vector data substantially represents the modified widthimage feature.

The way in which this functionality is achieved in accordance withembodiments will now be described with reference to FIGS. 7 to 10.

FIG. 7 is a schematic diagram of a camera captured image comprising userdrawn images in accordance with embodiments of the present invention. Inparticular, FIG. 7 shows a camera captured image 2000 comprising aplurality of user drawn images (corresponding to an arrow 2010, a star2020, a cross 2030, and a house 2040) which a user has drawn on thewhiteboard 1000. The cell processor 100 is operable to apply an imageprocessing operation to the camera captured images so as to generate animage feature which corresponds to a user drawn image.

In embodiments, the cell processor 100 is operable to apply an imagethreshold operation to the camera captured image so as to generate abinary image using known techniques. In embodiments, the binary image isa black and white image, although any other binary image could be used.In some embodiments, to generate the binary image, the cell processor100 is operable to detect which pixels of the camera captured image 2000have respective pixel values greater than an image threshold value.Those pixels whose respective pixel values are greater than the imagethreshold value are designated by the cell processor 100 as imagefeature pixels corresponding to an image feature. The image thresholdvalue may be preset within software, or set by a user in accordance withambient lighting conditions via a suitable user interface such as thecross media bar. However, any suitable image threshold value may beused.

Additionally, it will be appreciated that any suitable method ofgenerating the binary image could be used. In some embodiments, the cellprocessor 100 is operable to apply a blur filter to the captured imageusing known techniques to reduce image noise, image shadings and imageartefacts. The binary image can then be generated from the filteredimage. Therefore, changes in colour or gradients across the whiteboard1000 (for example due to lighting conditions on the whiteboard 1000) areless likely to affect the quality of the binary image.

In some embodiments, the cell processor 100 is operable to detect whichof the image feature pixels are contiguous with each other using knowntechniques. Those image feature pixels which are contiguous with eachother are designated by the cell processor 100 as belonging to the sameimage feature. However, any other suitable technique for detectingdifferent image features may be used. In this way several differentimage features may be distinguished from each other. Accordingly, eachimage feature can be processed separately, and in parallel on respectiveSPEs, to other image features, thus speeding up processing.

Additionally, in some embodiments, only image features within apredefined window in the camera captured image may be analysed. Thisreduces processing resources because not all the image needs to beanalysed. Additionally, other image features which may be unwanted ornot relevant, such as the perimeter of the whiteboard 1000, do not needto be processed and therefore the use of a predefined window excludesthese features before processing.

Once the image features have been generated from the camera capturedimage 2000, the cell processor is operable to thin each image feature toa line width which is smaller than a line width associated with thatimage feature so as to generate one or more modified width imagefeatures. This is illustrated with respect to FIG. 8.

FIG. 8 shows a schematic diagram of a camera captured image to whichimage processing and thinning has been applied in accordance withembodiments of the present invention. In particular, FIG. 8 showsmodified width image feature 2010′ (corresponding to the arrow 2010),modified width image feature 2020′ (corresponding to the star 2020),modified width image feature 2030′ (corresponding to the cross 2030),and modified width image feature 2040′ (corresponding to the house2040).

In embodiments, the cell processor 100 is operable to thin (skeletonise)each image feature to a line width which is smaller than a line widthassociated with the respective image feature by carrying out askeletonisation operation on each generated image feature such as thearrow 2010 or the house 2040. Skeletonisation is a technique known inthe art and so will not be described in detail herein.

For example, the cell processor is operable to thin a line width a ofthe image feature corresponding to house 2040 to a line width b of themodified width image feature 2040′, where b is less than a (b<a). Insome embodiments, once skeletonisation of an image feature has beencarried out, the line width of the respective modified width imagefeature is one pixel wide. This facilitates generating the vector datamore quickly because fewer pixels have to be analysed to generate thevector data. However, it will be appreciated that any suitable linewidth for the modified width image feature may be used.

Once an image feature has been skeletonised so as to generate a modifiedwidth image feature, the cell processor 100 is operable to generatevector data from pixels associated with the modified width image featureso that the vector data substantially represents the modified widthimage feature. In embodiments, the vector data comprises a plurality ofvectors, each having an associated magnitude and direction. However, itwill be appreciated that any other suitable type of vector data may beused, such as vector data relating to spline curves and the like.

The way in which vector data is generated in accordance with embodimentsof the present invention will now be described with reference to FIG. 9.

FIG. 9 shows a schematic diagram of a modified width image feature fromwhich vector data is to be generated in accordance with embodiments ofthe present invention. In particular, FIG. 9 shows the modified widthimage feature 2030′ (corresponding to the cross 2030). FIG. 9 also showsvectors 2050, 2060, 2070, 2080, 2090, and 3000. For the sake of clarityin understanding the drawing, not all the vectors representing themodified width image feature 2030′ are shown in FIG. 9. An angle in theanti-clockwise direction between vector 2070 and vector 2080 isillustrated as θ₁. An angle in the anti-clockwise direction betweenvector 2070 and vector 2090 is illustrated as θ₂. An angle in theanti-clockwise direction between vector 2070 and vector 3000 isillustrated as θ₃.

To generate the vector data, the cell processor is operable to scan, ona pixel-by-pixel basis, the pixels of the modified width image feature2030′ using known techniques to detect pixels which are adjacent andconnected to each other. In this case, connected is taken to mean anyadjacent pixel in any of a horizontal, vertical, or diagonal directionwith respect to a pixel of the modified width image feature.

For example, starting at a point 3010 on the modified width imagefeature 2030′ in FIG. 9, the cell processor 100 is operable to scanpixels surrounding the point 3010 to detect adjacent and connectedpixels. Then, starting from a detected adjacent and connected pixel, theprocess is repeated to find the next adjacent and connected pixel.

Once a predetermined number of adjacent and connected pixels have beendetected, the cell processor 100 is operable to generate a vectorcorresponding to start and end pixels corresponding to the predeterminednumber of connected pixels. In embodiments of the present invention, thepredetermined number of pixels is four, although it will be appreciatedthat any suitable value could be used. Additionally, the predeterminednumber of pixels can be altered within software depending on processingresources available, resolution required, and other suitable criteria.

For example, referring to FIG. 9, a start pixel corresponds to the point3010 on the modified width image feature 2030′, and an end pixelcorresponds to a point 3020 on the modified width image feature 2030′.Therefore, the cell processor 100 is operable to generate the vector2050 so as to correspond to a line joining the point 2010 and the point3020, thus substantially representing a portion of the modified widthimage feature 2030′ between the points 3010 and 3020.

The cell processor 100 is operable to carry out this process withrespect to each pixel start and end point so as to generate vectors suchas vectors 2060 and 2070. If, during processing, the cell processingdetects that there is more than one adjacent and connected pixel (suchas at a point 3030 in FIG. 9), then the cell processor 100 is operableto mark that pixel as corresponding to a vector junction. In otherwords, where there is more than one adjacent and connected pixel withrespect to a current pixel in the vector generation process, there ismore than one possible path. Therefore, the cell processor 100 isoperable to detect adjacent and connected pixels in respect of each pathso as to generate vectors accordingly.

In the example shown in FIG. 9, there are three possible paths from thepoint 3030, corresponding to vectors 2080, 2090 and 3000 respectively.The cell processor 100 is therefore operable to generate the vectors2080, 2090 and 3000 accordingly, and generate further vectors from theend points of each of the vectors 2080, 2090, and 3000.

The process of vector generation continues until all the pixels of themodified width image feature have been scanned and vectors generatedaccordingly so that the vector data substantially represents themodified width image feature.

In some embodiments, each of the vectors has substantially the same orthe same magnitude as each of the other vectors. This facilitatesinterpolation between image frames as each of the vectors hassubstantially the same magnitude (length) and therefore the start andend points of each vector are likely to be similar between successiveimage frames.

Once the vectors have been generated by the cell processor 100, the cellprocessor 100 is operable to analyse the generated vectors so as todetect vector object attributes such as lines and shapes.

In an embodiment, so as to detect lines of consecutive vectors, the cellprocessor 100 is operable to detect a relative angle between thedirection of a first vector and the direction of a second vectorconsecutive to the first vector. Here, consecutive is taken to mean avector whose start or end point corresponds with the start or end pointof another vector. For example, referring to FIG. 9, vector 2050 isconsecutive with vector 2060 because the end point of vector 2050corresponds with the start point of the vector 2060 at the point 3020.

If the cell processor detects that the relative angle between thedirection of the first vector and the direction of the second vector iswithin a threshold angle range with respect to the first vector, thenthe cell processor 100 is operable to associate the first vector and thesecond vector so as to generate vector association data indicative ofthe association between the first vector and the second vector. Inembodiments, the threshold angle range is between 175 degrees (175°) and185 degrees (185°), although it will be appreciated that any othersuitable threshold angle range could be used. In other words, in someembodiments, the threshold angle range is defined as 175°≦θ≦185°.Therefore, consecutive vectors which lie on substantially the samestraight line will be associated with each other. It will be appreciatedthat the threshold angle range and the angles between the vectors couldbe defined in any other suitable manner such as in radians, and thatother reference points or vectors could be used.

In some embodiments, the vector data comprises the vector associationdata, and the vector association data comprises one or more sets ofassociated vectors. In some embodiments, each set of associated vectorsrepresents a different line corresponding to a respective line of themodified width image feature. This advantageously allows each line to betreated separately when rendering the vector data, for example toemulate brush strokes or brush direction. Additionally, by applyingdifferent rendering operations as appropriate to different parts of themodified width image feature when it is rendered, an image can berendered which corresponds to a user drawn image but illustrated as ifthe user drawn image was drawn by a child.

An example of the association between vectors will now be described withreference to FIG. 9. As mentioned above, θ₁ is the angle in theanti-clockwise direction between the vector 2070 and the vector 2080, θ₂is the angle in the anti-clockwise direction between the vector 2070 andthe vector 2090, and θ₃ is the angle in the anti-clockwise directionbetween the vector 2070 and the vector 3000. In this example, θ₁=95°,θ₂=180°, and θ₃=275°. Therefore, when generating the vector associationdata, the cell processor is operable to associate the vector 2090 withthe vector 2070 because the respective angle between vector 2070 andvector 2090 (θ₂=180°) lies within the threshold value range, thusindicating the two vectors lie on the same line of the modified widthimage feature 2030′.

However, the vector 2080 and the vector 3000 will not be associated withthe vector 2070 because their respective angles with the vector 2070(θ₁=95°, and θ₃=275°) lie outside the threshold angle range thusindicating they are not in the same direction as the vector 2070 andtherefore unlikely to correspond to the same line of the modified widthimage feature 2030′.

It will be appreciated that other suitable object detection and shaperecognition techniques could be used to generate the vector associationdata. Additionally, other relationships between vectors could bedetected so as to generate the vector association data as appropriate.

The above described method of generating vector data has a number ofadvantages over the method described with respect to FIG. 5.

Firstly, the size of the vector data can be substantially smaller thanthat required to represent the whole user drawn image because the vectordata is generated from the skeletonised user drawn image, which hasfewer vectors than if the vectors were randomly distributed within theoutline of the user drawn image as described above with reference toFIG. 5.

Secondly, because fewer pixels need to be scanned and analysed in orderto generate the vector data, processing resources can be reduced, thusallowing the vector data to be generated substantially in real time; thevector data generated in accordance with the embodiments describedherein is based on a skeletonised image rather than the whole user drawnimage. Additionally, the skeletonised image is thinner than a line widthof the image feature corresponding to the user drawn image and thereforethere are fewer pixels to analyse.

Thirdly, many different image rendering operations may be carried outwhen rendering the modified width image feature so as to correspond tothe user drawn image. For example, image rendering operations such asskew, distortion, rotation, enlarge, shrink and the like may be carriedout because the vector data represents the skeletonised shape ratherthan randomised vectors which fill in the outline of the user drawnimage. As another example, lettering drawn by a user could be drawnwithin a game as balloons, lightning or any other shape according toinput by the user of a setting within software.

A method of generating vector data from a camera captured imagecomprising a user drawn image will now be described with reference toFIG. 10.

FIG. 10 is a flowchart of a method of generating vector data inaccordance with embodiments of the present invention.

At a step s100, the cell processor 100 receives a camera captured imagefrom the camera 756. As mentioned above, a user may hold at least partof a user drawn image within the field of view of the camera 756 so thatthe camera captured image comprises the user drawn image.

Then, at a step s105, the cell processor 100 applies image processing tothe camera captured image so as to generate an image feature whichcorresponds to the user drawn image. The image processing operation maycomprise an image threshold operation as mentioned above. In otherembodiments, which will be described in more detail below, the imageprocessing operation comprises a flood fill operation together withdetection of boundary pixels. Alternatively, these image processingoperations may be combined.

At a step s110, the cell processor 100 thins (skeletonises) thegenerated image feature to a line width which is smaller than a linewidth associated with the image feature so as to generate a modifiedwidth image feature as described above.

Then, at a step s115, the cell processor generates vector data asdescribed above from pixels associated with the modified width imagefeature so that the vector data substantially represents the modifiedwidth image feature. The vector data can then be used to reproduce theuser drawn image whilst allowing different rendering operations to beperformed on the vector data.

As an example of the use of the vector data, a user drawn image such asthat of a car may be used to transform a two-dimensional drawing by auser into a virtual three-dimensional object. For example, a threedimensional virtual model of the drawing in the captured image can begenerated using a set of rules specific to an archetypal model withwhich the drawing is associated.

To do this, the cell processor can generate vector data from a userdrawn image as described above. A set of transformational rules specificto the archetypal object are then applied by the cell processor 100 tothe vector data. In the case of the car, the main body is extruded intothe third dimension, for example by an extent proportional to the lengthof the drawn object. Meanwhile, the front and rear wheels (front andrear may be determined by a simple left/right convention, for example,or according to the archetype) are offset in the third dimension withrespect to the main body and extruded to a much smaller degree. Inaddition, a second pair of wheels is generated by copying the front andrear wheels, and are offset in the third dimension to the far side ofthe car. In this way, a two-dimensional physical drawing can be used asthe template for building a three dimensional virtual object, withdifferent elements of the drawing undergoing different extrusions,duplications or other transformations in 3D according to theiridentified role with respect to the associated archetypal object.Generation of a three-dimensional model from a two-dimensional drawingis described in European Patent Application Number 08252735.9, theentire contents of which is hereby incorporated herein by reference.

However, if a user makes a mistake when drawing or is not a veryaccomplished artist, then they may draw an object, such as a circlecorresponding to wheel, without accurately representing the object.Therefore, the cell processor 100 may be unable to recognise anarchetypal object and therefore may not be able to generate theappropriate three-dimensional virtual model.

The way in which embodiments of the present invention address thisproblem will now be described with reference to FIGS. 11 to 13.

FIG. 11 is a schematic diagram of a camera captured image comprising auser drawn image in accordance with embodiments of the presentinvention. In particular, FIG. 11 shows a camera captured image 4000comprising a user drawn image 4010. As is shown in FIG. 11, the userdrawn image 4010 substantially corresponds to a broken circle. However,the user drawn image 4010 is not a continuous circle and has a gap 4020where the circle is incomplete. For example, if the user drawn image4010 was intended by the user to correspond to the wheel of a car, thecell processor 100 may have difficulty in detecting the user drawn imageas corresponding to a wheel because the user drawn image 4010 is not acontinuous circle.

Therefore, in order to bridge the gap 4020 so that the cell processorcan generate vector data from the user drawn image and use the generatedvector data to generate a virtual wheel, in embodiments, the cellprocessor 100 is operable to carry out a flood fill operation on thecamera captured image 4000 (as indicated by the dotted shading in FIG.11). Flood fill operations are known in the art and so will not bedescribed in detail herein.

In some embodiments, the cell processor 100 is operable to apply animage threshold operation as described above to the camera capturedimage before or after the flood fill operation is carried out. However,in other embodiments, the image threshold operation need not be carriedout.

The cell processor 100 is operable to detect boundary pixels associatedwith a boundary between a first image region corresponding to the userdrawn image 4010 and a second image region corresponding to a floodfilled image area, such as that corresponding to the dotted shadedregion in FIG. 11 using known techniques such as edge detection. Theboundary pixels are schematically illustrated in FIG. 12 which is aschematic diagram of a boundary between a flood filled image region anda user drawn image in accordance with embodiments of the presentinvention.

FIG. 12 shows an inner boundary 4030, an outer boundary 4040, and gapboundaries 4050 a and 4050 b. Although the boundaries in FIG. 12 areshown as not being adjacent to the image region corresponding to theuser drawn image 4010, it should be understood that this is for thepurposes in understanding the drawing and that the boundaries would besituated so that they were in contact with the image regioncorresponding to the user drawn image 4010. Pixels lying on theboundaries between the flood filled image region and the image regioncorresponding to the user drawn image 4010 are designated as boundarypixels.

In some embodiments, the cell processor 100 is operable to mask pixelsof the camera captured image which do not correspond to boundary pixels.To achieve this functionality, those pixels which are detected as notcorresponding to boundary pixels are flagged by the cell processor 100so that the non-boundary pixels can be ignored during later processing.This reduces processing resources needed for further image processing onthe boundary pixels as described below with reference to FIG. 13 becausethe flagged non-boundary pixels need not be processed.

Once the cell processor has detected the boundary pixels, the cellprocessor 100 is operable to associate, for each boundary pixel, apredetermined number of pixels surrounding the boundary pixel with thatboundary pixel. This is illustrated in FIG. 13.

FIG. 13 is a schematic diagram of the association of pixels withdetected boundary pixels in accordance with embodiments of the presentinvention. In the embodiment schematically illustrated in FIG. 13,pixels such as pixels 4070 are represented by squares and boundarypixels corresponding to the inner boundary 4030, such as boundary pixels4080, are represented by squares shaded with dots. Additionally, in theembodiment shown in FIG. 13, 8 surrounding pixels are associated witheach boundary pixel, although any other number of pixels could beassociated with each boundary pixel. To illustrate this, a boundarypixel 4060 is shown surrounded by eight other pixels. Each boundarypixel is associated with surrounding pixels so that together theboundary pixels and the pixels associated with the boundary pixels formthe image feature. Therefore, the gap 4020 can be filled, thus forming acontinuous circle. In other words, the process described with referenceto FIG. 13 can be thought of as being analogous to drawing with a thickbrush at every point in the image corresponding to a boundary pixel.Here, a thick brush should be taken to mean a brush having a diametergreater than a diameter associated with a boundary pixel.

The cell processor 100 is then operable to skeletonise the generatedimage feature and generate the vector data as described above.Therefore, even though the user drawn image was not a closed shape, byapplying the above described method, the cell processor 100 canassociate pixels with gaps in the user drawn shape and thus enable anarchetype to be recognised correctly.

It will be appreciated that, whilst the process described above withreference to FIG. 13 can allow an archetype to be recognised correctly,some details of the user drawn user may be reduced due to theassociation of other pixels with the boundary pixels (i.e. a thickeningoperation). Therefore, when a three-dimensional model generated from theuser drawn image is displayed to a user, the user may be disappointedthat some detail may have been lost and therefore the 3D object may notappear to them as they may desire.

To address this, in some embodiments, the cell processor 100 is operableto generate vector data as described above from the inner boundary of anobject following the flood fill operation. For example, referring toFIG. 13, the cell processor 100 is operable to generate vector data fromthe inner boundary 4030. In other embodiments, vector data could also begenerated from an outer boundary (such as outer boundary 4040) as wellas, or instead of, from the inner boundary.

As mentioned above, in some embodiments, the cell processor 100 isoperable to use the vector data generated from the thickening processdescribed above with reference to FIG. 13 to generate a suitablethree-dimensional object according to an archetype of an object.However, to improve the appearance of the three-dimensional object to auser, the cell processor 100 is operable to render an outline of theuser drawn image on the three-dimensional object based on the vectordata generated from the inner and/or outer boundary. The detail of theuser drawn image is likely to be more accurately represented by thevector data generated from a boundary and therefore, when rendered onthe three dimensional object a user is more likely to be satisfied thattheir drawing has been correctly reproduced in three dimensions. Inother words, the vector data generated from a boundary can be renderedso that it appears as if stamped on the 3D object.

It will be appreciated that the above described techniques may becombined as appropriate. For example, the skeletonisation techniquedescribed above with reference to FIGS. 7 to 10 may be applied to thesome or all of the image feature generated by associating pixels withboundary pixels as described above with reference to FIG. 11.

Additionally, it will be appreciated that any suitable camera may beused to capture the camera captured images, such as a camera operable tocapture two-dimensional images, a camera operable to capturetwo-dimensional images together with depth data indicative of a distancebetween the camera and objects in the field of view of the camera, andthe like. In embodiments, the camera may be a video camera, a webcamera, and the like.

Finally, it will be appreciated that the methods disclosed herein may becarried out on conventional hardware suitably adapted as applicable bysoftware instruction or by the inclusion or substitution of dedicatedhardware.

Thus the required adaptation to existing parts of a conventionalequivalent device may be implemented in the form of a computer programproduct comprising processor implementable instructions stored on a datacarrier such as a floppy disk, optical disk, hard disk, PROM, RAM, flashmemory or any combination of these or other storage media, ortransmitted via data signals on a network such as an Ethernet, awireless network, the Internet, or any combination of these of othernetworks, or realised in hardware as an ASIC (application specificintegrated circuit) or an FPGA (field programmable gate array) or otherconfigurable circuit suitable to use in adapting the conventionalequivalent device.

In conclusion, although a variety of embodiments have been describedherein, these are provided by way of example only, and many variationsand modifications on such embodiments will be apparent to the skilledperson and fall within the scope of the present invention, which isdefined by the appended claims and their equivalents.

Although illustrative embodiments of the invention have been describedin detail herein with reference to the accompanying drawings, it is tobe understood that the invention is not limited to those preciseembodiments, and that various changes and modifications can be effectedtherein by one skilled in the art without departing from the scope andspirit of the invention as defined by the appended claims.

1. An image processing method comprising: receiving, from a camera, acamera captured image comprising a user drawn image, at least part ofthe user drawn image being within a field of view of the camera;applying an image processing operation to the camera captured image soas to generate an image feature within the camera captured image whichcorresponds to the user drawn image; thinning the image feature to aline width which is smaller than a line width associated with the imagefeature so as to generate a modified width image feature; and generatingvector data from pixels associated with the modified width image featureso that the vector data substantially represents the modified widthimage feature.
 2. A method according to claim 1, in which: the imageprocessing operation comprises applying an image threshold operation tothe camera captured image so as to generate a binary image; and theimage threshold operation comprises detecting pixels of the cameracaptured image whose respective pixel values are greater than an imagethreshold value, in which the image feature corresponds to those pixelswhose respective pixel values are greater than the image thresholdvalue.
 3. A method according to claim 1, in which: the image processingoperation comprises: carrying out a flood fill operation on the cameracaptured image so as to detect boundary pixels associated with aboundary between a first image region corresponding to the user drawnimage and a second image region corresponding to a flood filled imagearea; and for each boundary pixel, associating a predetermined number ofpixels surrounding the boundary pixel with that boundary pixel, in whichthe image feature comprises the boundary pixels together with the pixelsassociated with those boundary pixels.
 4. A method according to claim 3,in which the flood fill operation comprises masking pixels of the cameracaptured image which do not correspond to boundary pixels.
 5. A methodaccording to claim 1, in which the vector data comprises a plurality ofvectors, each having an associated magnitude and direction.
 6. A methodaccording to claim 5, in which each of the vectors has substantially thesame magnitude.
 7. A method according to claim 5, in which generatingthe vector data comprises: detecting a relative angle between thedirection of a first vector and the direction of a second vectorconsecutive with the first vector; and associating the first vector withthe second vector if the relative angle between the direction of thefirst vector and the direction of the second vector is within athreshold angle range with respect to the first vector.
 8. A methodaccording to claim 6, in which generating the vector data comprises:detecting a relative angle between the direction of a first vector andthe direction of a second vector consecutive with the first vector; andassociating the first vector with the second vector if the relativeangle between the direction of the first vector and the direction of thesecond vector is within a threshold angle range with respect to thefirst vector.
 9. A method according to claim 1, in which the line widthof the modified width image feature is one pixel wide.
 10. A tangiblecomputer readable medium on which is stored instructions of a computerprogram, the instructions, when executed by a processor of a computer,cause the computer to perform an image processing method comprising:receiving, from a camera, a camera captured image comprising a userdrawn image, at least part of the user drawn image being within a fieldof view of the camera; applying an image processing operation to thecamera captured image so as to generate an image feature within thecamera captured image which corresponds to the user drawn image;thinning the image feature to a line width which is smaller than a linewidth associated with the image feature so as to generate a modifiedwidth image feature; and generating vector data from pixels associatedwith the modified width image feature so that the vector datasubstantially represents the modified width image feature.
 11. Imageprocessing apparatus comprising: an image receiver to receive, from acamera, a camera captured image comprising a user drawn image, at leastpart of the user drawn image being within a field of view of the camera;an image processor to apply an image processing operation to the cameracaptured image so as to generate an image feature within the cameracaptured image which corresponds to the user drawn image; an imagethinner to thin the image feature to a line width which is smaller thana line width associated with the image feature so as to generate amodified width image feature; and a vector data generator to generatevector data from pixels associated with the modified width image featureso that the vector data substantially represents the modified widthimage feature.
 12. An image processing system comprising: an imageprocessing apparatus; and a camera operable to capture a camera capturedimage comprising a user drawn image, and to transmit the camera capturedimage to the image processing apparatus, the image processing apparatuscomprising: an image receiver to receive, from the camera, the cameracaptured image comprising the user drawn image, at least part of theuser drawn image being within a field of view of the camera; an imageprocessor to apply an image processing operation to the camera capturedimage so as to generate an image feature within the camera capturedimage which corresponds to the user drawn image; an image thinner tothin the image feature to a line width which is smaller than a linewidth associated with the image feature so as to generate a modifiedwidth image feature; and a vector data generator to generate vector datafrom pixels associated with the modified width image feature so that thevector data substantially represents the modified width image feature.13. Image processing apparatus comprising: receiving means operable toreceive, from a camera, a camera captured image comprising a user drawnimage, at least part of the user drawn image being within a field ofview of the camera; image processing means operable to apply an imageprocessing operation to the camera captured image so as to generate animage feature within the camera captured image which corresponds to theuser drawn image; image thinning means operable to thin the imagefeature to a line width which is smaller than a line width associatedwith the image feature so as to generate a modified width image feature;and vector data generating means operable to generate vector data frompixels associated with the modified width image feature so that thevector data substantially represents the modified width image feature.14. An image processing system comprising: an image processingapparatus; and a camera operable to capture a camera captured imagecomprising a user drawn image, and to transmit the camera captured imageto the image processing apparatus, the image processing apparatuscomprising: receiving means operable to receive, from the camera, thecamera captured image comprising the user drawn image, at least part ofthe user drawn image being within a field of view of the camera; imageprocessing means operable to apply an image processing operation to thecamera captured image so as to generate an image feature within thecamera captured image which corresponds to the user drawn image; imagethinning means operable to thin the image feature to a line width whichis smaller than a line width associated with the image feature so as togenerate a modified width image feature; and vector data generatingmeans operable to generate vector data from pixels associated with themodified width image feature so that the vector data substantiallyrepresents the modified width image feature.